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ABSTRACT 

TheU.S, Department of Education makes a considerable 
investment in math and science education each year. This document 
discusses the Eisenhower Mathematics and Science Education Program, 
the largest of the Department of Education's programs dedicated to 
math and science. This program includes: (1) The National Program 
(funding nearly $16 million in FY 1993) and (2) the State Grant 
Program (providing $250 million a year to states for professional 
development to improve teachers' skills and the quality of teaching 
in math and science in elementary and secondary schools.) The 
evaluation and monitoring of the Eisenhower national and state grant 
programs are discussed, including development of performance 
indicators, annual state performance reports, and indicators for 
systemic reform. Next steps include an in-depth evaluation of what 
the Eisenhower Program is contributing to improvements in teachers' 
skills and the quality of classroom instruction. (MKR) 
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The Eisenhower Mathematics and Science Education Program 

Presefitation at the 
Annual Meeting of the American Educational Research Association 
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by Nancy Loy 



Investment in math and science education 

The I'.S. Department of Education (ED) makes a considerable investment in math and 
science education every year. As shown in Table 1 below, in ¥\ 1993, the IDepi.rtmcnt spent 
SM\ million on core programs dedicated specifically to math and science education. Ninety- 
six percent of this funding supported education at the elementary and secondary levels, 
including professional development for classroom teachers. This was the largest inxestment ol 
any federal agency in math and science education at the elementary and secondary le\'el. 
according to the Federal Coordinating Council for Science, Engineering, and l\:chnology 
;FCCSET, precursor to the National Science and Technology Council (Expert Panel for the 
F^eview of Federal Education Programs in Science, Mathematics, Engineering, and 
1 Vchnology, 1993, Table U6, p. 9). 

Thrsc figures actually understate the in\'estment in math and seiencc education, lor \.hv\ touni 
only core maih and science education programs. In addition, the I'.S. Department ol 
Education supports other education programs that include math and science, but are not 
dedicated solely to math and science. Most notable among these is the Chapter 1 Program 
for Educationally Disadvantaged Children. ED's Chapter 1 Program provided instruction in 
mathematics to an estimated three million disadvantaged children in FY 1993 (Sinclair and 
Cuimann, 1991 forthcoming). 

I' ViS(-nh ( )wcM' Mathematic^s and Science Education National Pr ogram 

The largest among ED's programs dedicated to math and science is the Eisenhower 
Mathematics and Science Education Program. Eisenhower includes: (1) thc^ National 
Program and (2) the State Grant Program. The Eisenhower National Program i)ro\'ides 
discretionary grants to support projects of national significance to improw the (lualiiy ol 
t(\iching in mathematics and science, such as grants to help states de\'elop new curriculum 
frameworks. Funding totalled nearly SH) million in FY 1993. 
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Table 1 



Core Science, Mathematics, Engineering and 
Technology Education (SMET) Programs 
FY 1993 Budget Totals 



FEDERAL 
AGENCY 


TOTAL BUDGET 
FOR SMET 
EDUCATION 
(millions) 


ELEMENTARY AND 
SECONDARY LEVELS 

(millions) 


NSF 


5537.9 


S309.8 


DEFENSE 


526.7 


21.8 


HHS 


464.1 


26.9 


ED 


340.9 


328.3 


ENERGY' 


102.1 


27.-1 


INTERIOR 


86.0 


23.0 


NASA 


79.8 


20.5 


A(;Rici'i;ri'RE 


21.1 


1.2 


SMITHSONIAN 


10.1 


0.7 


EPA 


9.0 


7.1 


COMMERCE 


5.2 


0.0 


Total 


52,186.2 


57(i9.5 



Adapird from; \'\\\)vvi Panel lor ihr Rrvicw of l-Vdrral Kducation Programs in Science, 
Mathematics, [engineering, and 'Teehnotogy (1993). 'Ike Federal Investment in Srienre, 
Mathematics, Engineering, and 'I'eclniolog\' Education: Wlieie jYow? What Xe\t? Sourcebook. /\rlingl 
\'A: National Science l-\)undation; 'I able l-G, p. 9. 



Also under the Eisenhower National Program is the Regional Consortiums Program. The lU 
Regional Consortia coordinate with the Eisenhower National Clearinghouse to disseminate 
exemplary instructional materials for math and science. The Consortia also provide technical 
assistance to help states implement new curricula, teaching methods, materials, and assessment 
tools in elementary and secondary schools. Funding to the Consortia was separate from 
Eisenhower National Program appropriations and totalled nearly S14 million in l^-" 1993. 

Currently, the U.S. Department of Education is evaluating both the Eisenhower National 
Program State Curriculum Frameworks Projects and the Regional Consortiums Program 
through a contract with SRI International and its subcontractors, Policy Studies Associates, 
inc., and the Council of Chief State School Officers (CCSSO). In the evaluation of the Suiu- 
Curriculum Frameworks, we are examining the process through which states are developing 
their frameworks, the quality of the frameworks within the context of what the different states 
are trying ^o accomplish, alignment of the state frameworks with national standards, equity 
issues, and implementation through state policies, and through alignment of teacher 
preparation, teacher certification, and professional development. In the evaluation of the 
Regional Consortiums Program, we are focusing on the technical assistance they pro\'ide, their 
dissemination of exemplary materials, other Consortia ser\'icc»s, and th'^ nieht* [hv Consoriia 
have shaped within the contcwt of \arying needs among tht' dilTcM-eni regions. 

In both EiscMihower e\'aluations, we are examining their relationship with oihtT siau and 
federal educational reform efforts, including Gon^' 2000, the Eisenhower State Grant Program, 
and the National Science Foundation's (^'^ .cucwidc Systemic Iniuatives (SSI). Through 
both evaluations., we are seeking to learn wiiat is working, what is not, and why, and lo \\h<u 
extent these Eisenhower programs are contributing to systemic reform and impro\'ements in 
math and science education. To accomplish these objectives, the U.S. Deixirtment of 
Education is coordinating its evaluations with NSFs SSI evaluation and with CCSSO's siudy 
of state curriculum frameworks. 

Ijst* nhower Mathematics and Science State Grant Program 

The largest part of the Eisenhower Mathematics and Science Program is the State Grant 
Program. The Eisenhower State Grant Program provides S250 million a year to states for 
])rofessional development activities to improve teachers' skills and the quality of teaching in 
math and science in elementary and secondary schools. The program also emphasizes 
improx'ing instruction for underscr\'ed and underrei)resented j)opulaii()ns, including fcMiiales. 
racial and ethnic minorities, economically disad\'antaged |)opulations, and studenis with 
disabilities. 
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Figure 1 

Distribution of Eisenhower State Grant Program Funds 

Federal Funds (U.S. Department of Education) 



75% 



25% 



State Agencies tor 
Elementary and 
Secondary Education 
(SEAs) 



State Agencies tor 
Higher Education 
(SAHEs) 




LEA Funds 



D&E Projects 



Higher*Education Grants 



Updated from Knapp, M. S., et al. (1991). The Eisenhower Mathematics and Science Education 
Program: An Enabling Resource for Reform. Menlo Park, CA: SRI Intcrnaiional. Figure 1, p. 4. 



As shown in Figure I below, ai leasi two-thirds of the Eisenhower State Grant Program 
funding Hows to sehool districts through formula grants, based on local demographics 'updated 
from Knapp et al, 1991, Figure 1, page 4). School districts use the Eisenhower Staic formula 
grants primarily to provide in-scr\'ice professional development for classroom teachers. 
Colleges and universities use one-fourth of the Eisenhower State Grant funding for in-ser\ ice 
professional development and some pre-service teacher preparation. State Education .Agencies 
use the remainder for demonstrauon projects, technical assistance, and program 
administration. 

SRI International completed an evaluation of the Eisenhower State Grant Program for the 
U.S. Department of Education in 1990, examining the scope of the program and the nature 
of Eisenhower activities. The evaluation found thai the program provided funds to \ iriually 
all school districts in the United States, and that an estimated one-ihird of all math and 
science teachers, including elementary school teachers, took part in activities funded by the 
program. Yet, formula grants to school districts paid for an average of only six hours ol 
training per participant (Knapp et al., 1991, p. xiv).* 

The evaluation found that the projects funded by the formula grants did provide the 
opportunity for large numbers of teachers to become aware of reform ideas, make connections 
with colleagues, and expand their interest in math and science teaching. However, the (lualiiy 
of the professional development provided through the formula grants varied considerably. 
.Although some distriets used Eisenhower funding for well-designed sialT development wiih 
reportedly clear imi)act on teachers' classroom i)ractices, other districts used ii for ad Ikk 
training that was not linked to a eomprehensi\'e strategy. In contrast, Eisenhower 
discreuonary grants to colleges and universities averaged 60 hours per participant and 
provided more intensive professional development acuvities with greater impact than the 
formula grants (Knapp et al., 1991, pp. xiv-v). 



Oiher e\-aluaiion aciix'iiie s 

In addition lo evaluating its own programs, the U.S. Department of l-.ducation also 
coordinates with other federal agencies on evaluation as an active memi)er ol the 
Dissemination and Evaluation Working Group of the National Science and Technologv 
Council (NS'lX::), formerly the Federal Coordinating Council on Science, Engineering, and 
Technology (FCCSET). Vor example, we have worked with F(;C;SET's exi)ert i)aneL uhich 
reviewed federal programs in math, science, and technology education, as well as evaluations 
of these programs, and made recommendations to strengthen the federal investment in these 
areas. The Department has also provided input to the National Research Council (KllC) foi 
its work developing indicators for the National Aeronautics and Space Administration's 



■'The study was conducted during school year 1988-89. 
Eisenhower State Grant Program funding for FY 1989 was $128 
million, about half the level of funding in FY 1994. 



(NASA's) education programs. Currently, through the NSTCs Dissemination and Evaluation 
Working Group, we are collaborating on evaluation plans for agencies' math and science 
education programs, and on plans for a joint evaluation of selected teacher enhancement 
programs across federal agencies. 

Monitoring the Eisenhower Sf.uc Grant Program 

The U.S. Department of Education conducts program evaluations to provide an in-depth look 
at its programs. Yet, evaluations are just one part of the picture. The Department also 
conducts on-going monitoring to maintain up-to-date information on what is happening in its 
programs, to track changes, and to provide red flags to alert us to problems that we need to 
address. To monitor the Eisenhowc*r State Grant Program, the Department conducts site 
x'isits to selected states. These site visits, plus follow-up work, gi\*e us fairly in-depth 
information on what the Eisenhower projects arc doing and how Eisenhower funds are spent. 
However, we are able to conduct site visits to only 5-10 states each year because of the time 
investment and travel funds they require. 

Clomplementing the site visits, we also monitor the Eisenhower State Gram Program through 
annual state performance reports, which all states send to the Department every year. In 
addition to providing information about each individual state, these performance reports give 
us a picture of the program as a whole, and enable us to make cross-state comparisons. 

Developing performance indicators for the Eisenhower State Gir ant IVoeram 

What changes is the Department making in monitoring the Eisenhower State Grant Pi'Ogiam/ 
We are taking a more comprehensive look at the program, dex'cloping a set of pcTformancc 
indicators, and making improvements in the annual state performance report forms. 

Although the Department has not fmished developing a set of performance indicators lor the 
Eisenhower State Grant Program, we have made progress. The National Academy of Public 
Administration (NAPA\ a non-proHt organization chartered by Congress to improx'C the 
effectiveness of gox'ernment. is working with the Department to help us develop sets oi 
performance indicators for a number of our programs, for program management, program 
im[)ro\-ement, accountability, and budget and i)olic\- decisions. 

N.AP.A proposed a framework of four categories of performance indicators: lni)ut indicator^, 
process indicators, outcome indicators, and context indicators ^summarized from Wye, C.. et 
al., 19f)3): 

0 In put ind ic ators to describe the size and scope of the program: ftinding. staftin.i:. and 
lither resources for |)ro,^ram mana.^cMnent. 



o Process indicators to describe services, activities, and participants funded through 
program expenditures. 



o Outcome indicators to assess progress toward goals in terms of teachers' skills and ih(^ 
quality of insti'uction/ 

o Context indicators to describe the environment in which the program operates, such as 
curriculum de\'elopment and trends in student achievement.^ 

Based cn the framework that NAPA proposed, the De[)artment is currently developing a set of 
indicators. The Department will draw data together for the indicators from a variety of 
sources of information, including the annual state performance reports, to obtain a more 
comprehensive, integrated picture of the program and the context within which it operates. 
NAPA focused on the annual state performance reports as a realistic source of information lor 
some of the input indicators, such as Eisenhower funding, and for some of the [)rocess 
indicators, such as Eisenhower-funded services, activities, and participation .'AVye. Cl.. c*i al.. 
1993;. 

Kisenhower State Grant Program annual state performance reports 

States have submitted |:)erformancc reports since the Eisenhower State CIrant Program suiriecl. 
When the i)rogram began in school year 1985-86. as Title 11 of the 198-1 Ixlucation for 
[economic Security .Act, the Department asked states to report annually on how ihcy spnu 
their Title II money and whether they met the objectiws they had set for the program. The 
usefulness of the information reported by states was limited, because the information was 
narrative and varied tremc^ndously from state to state. Four years later, when the program 
started operating as the Eisenhower State Grant Program under the 1988 Elementary and 
Secondary Education Act, the Department developed more detailed (juestionnaires lor stales 
to submit comparable data, beginning with school year 1989-90. 

Recently, the Department has made impro\'ements in the questionnaire we i)ro\'ide lor the 
annual state performance reports, with assistance from AVestat. Inc . In addition to considering: 
the pcM-formanee rej^orts within the broader framework that NAPA suggc«sted. we ha\'e made 



'NAPA noted that the Eisenhower legislation specifically 
defined the objectives of the program in terms of teachers' 
skills and quality of instruction, not in terms of student 
outcomes (Wye, C, , et al, 1993). 

'Many of the kinds of indicators identified by Richard J. 
Murnane and Senta A, Raizen (1988) also would be considered 
context indicators • 



two other major improvements, by focusing on state-level issues and direcily addressing 
indicators for systemic educational reform. 

Before the Department can use any questionnaire to collect data, including the annual state 
performance report form, it must be reviewed and approved by the Office of Managemcni 
and Budget (0MB). 0MB has been very much involved in our efforts to improve the 
performance report form. One recommendation that both 0MB and NAPA made was thai 
we be sure to ask states for information that they can provide. This point may sound simple. 
However, since the state performance reports are the only annual source of information the 
Department receives on the program nationwide, it is tempting to try to get all the 
information wc need from this single source. Yet, as 0MB and NAPA reminded us, an 
annual report from states is not a realistic source for detailed information on local Kisenhower 
activities, much less would it be an appropriate source for detailed information on individual 
participants. For that kind of information, we are now considering a combination of surveys 
of samples of school districts, surveys of participants in Eisenhower activities, and in-depih 
evaluation. 

In addition to eliminating some questions from the annual state performance report thai had 
asked fcr detailed information about local Eisenhower activities and participants, we have 
started addressing some issues concerning the role of the State Education Agency that we had 
not addressed earlier, such as questions about the placement and staffing of the Eisenhower 
office within the State Education Agency (SEA). We also are looking at the role of the state 
in providing direction and guidance to school districts. As one indicator, we are asking about 
the extent to which SE.As decide the [)nonties for local school districts to follow in tin* 
iMsenhower Program or allow local HcNibility. 

Directlv addressing indicators for svstemic reform 

In addition to asking more appropriate state-level questions on the annual state perlormance 
report, the Department also is directly addressing indicators for systemic educational relorni. 
There is growing recognition by the education community of tlie importance ol systemic- 
reform to improve teaching and learning. Instead of focusing on isolated professional 
development activities, the Department is encouraging states to use Eisenhower funds as pan 
of a broader plan to support systemic educational reform. For example, if a state has 
developed a new curriculum framework for math, the state could use Eisenhower funds lor 
professional development activities to familiarize teachers with the new curriculum framework 
and to pro\-ide training in related instructional practices. 

The new annual state i)erformance report form reflects this shift in focus and asks si)ecincally 
about activities that would supi)ort systemic reform, such as alignment of Eisenhower |)ri()rities 
with other reform efforts, such as curriculum framework development and student assessment, 
and colla!)t)ration with other i)ro;j;rams, such as the I jscnhower Regional Consortia. ED's 
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Regional Educational Laboratories, NSPs SSI and Teacher Collaboratives, NASA's programs, 
U.S. Department of Energy's laboratories, and other federal and state programs. 

No.xt steps 

At the U.S. Department of Education, we have made progress, but we still have a long way to 
go in monitoring and evaluating the Eisenhower Program. We have begun co develop a set of 
performance indicators and will draw together information from a variety of sources to 
formulate a comprehensive picture of the program across states and over time. We have 
revised the annual state performance report within this broader framework. In addition, we 
will be conducting in-depth evaluations for a better understanding of what is working, what is 
not working, and why, and to what extent the Eisenhower Program is contributing to 
improvements in teachers* skills and the quality of classroom instruction. 
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